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HE OBJECTIVE measurement of clini- 
Tai status in psychopathology seems 
to be a necessary, although not a sufh- 
cient, condition to further progress in 
various types of therapy. The solution of 
many problems, such as the efficacy of 
a particular treatment, more refined clas- 
sification of disease syndromes, the nature 
of the changes that take place during the 
course of treatment, etc., are contingent 
in part upon the development of more 
adequate measuring devices. Although 
the past decade has witnessed tremendous 
growth in the development of therapeutic 
techniques, it has produced few of the 
precise tests that are needed to predict 
and evaluate the results of the new meth- 
ods of treatment. 

One acute problem facing the present- 
day therapist is the choice of treatment 
for a particular patient. Should the pa- 
tient be treated psychotherapeutically, 
eg. by psychoanalysis, nondirective 
therapy, etc., or should a more drastic 
type of treatment be used, e.g., shock 
treatment, psychosurgery, etc.? In this 
situation some guiding principles based 
upon empirical evidence would be of 
material benefit. At the present time, 
however, the evidence is insufficient to 
evaluate the relative merits of the vari- 
ous treatments. On the basis of clinical 
experience we do have some notions 
about selecting patients for particular 
types of therapy. Some of the rules help 
to decide the suitability of a patient for 
one type of treatment, but alternative 
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CHAPTER I 
INTRODUCTION? 


choices are seldom specified. Thus a 
transference neurosis is generally assumed 
to be amenable to psychoanalytic treat- 
ment, but it is not known whether non- 
directive therapy would do as well. Then, 
too, although some of the rules un- 
doubtedly are valid for groups of pa- 
tients, they offer little direction in the 
individual case. For example, although 
drastic types of treatment are usually re- 
served for psychotic patients, it may be 
that a sizable minority of psychotics 
would benefit much more from some 
form of psychotherapy. But at present 
we have little more than clinical 
“hunches” about which psychotic pa- 
tients would respond to psychotherapy. 
When the scope of comparison is nar- 
rowed to the various types of drastic 
treatment, there is at present no sound 
basis for deciding whether one type is 
more effective than the others for all cases 
or even for specific types of patients. In- 
sulin is usually reserved for the most 
severe cases of schizophrenia, whereas 
electric shock is thought to work best in 
affective disorders; yet it is a moot point 
whether these notions would be sub- 
stantiated in rigorous comparisons of 
matched groups. These few examples suf- 
fice to point out the need for objective 
instruments which could be used to test 
some of the conceptions held in current 
psychiatric practice. 

The purpose of the present study is to 
derive empirically a scale which predicts 
the results of shock treatment. The pro- 
posed scale may have several uses: 

1. A practical use. To obtain some 
means of selecting patients for whom 
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shock treatment would probably be suc- 
cessful. 

2. A theoretical use. To facilitate a 
formulation concerning the differences 
in personality structure of those patients 
who respond well and those who respond 
poorly to shock treatment, in so far as 
these differences are reflected in changing 
verbal responses to test items. 

3. A heuristic use. To furnish a ra- 
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tional basis for selecting patients for 
numerous possible comparative studies of 
therapy. 

Thus, the present investigation is un- 
dertaken in the belief that an objective 
scale which predicts the results of shock 
treatment will not only have practical 
utility but will also be of theoretical 
interest. 
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HE PRESENT investigation attempted 
T to derive a prognostic scale for shock 
therapy. The scale is labeled Ps in keep- 
ing with its intent, namely, prognosis for 
shock treatment. The Minnesota Multi- 
phasic Personality Inventory (MMPI) 
furnished the initial pool of items for 
the Ps scale. The MMPI need not have 
been chosen as the pool of items for the 
new scale. In fact, a new pool of items 
could have been devised to reflect a more 
dynamic personality theory than do the 
items on the MMPI. Such a pool of items 
might have yielded even better discrimi- 
nations than were obtained with the 
items actually used. The MMPI was 
used for two reasons: 

1. Most important was a practical rea- 
son. A group of records was already avail- 
able on a sizable number of patients 
treated with shock therapy. These records 
constituted a fairly representative sample 
of patients at the clinic. 

2. Another reason was that a large 
body of knowledge had been accumu- 
lated on the results of the MMPI. In 
correlating Ps with these results, valua- 
ble insights might be gained into the 
nature of the new scale. 


The MMPI has been described in detail else- 
where (4, 5, 7, 8, 9). Hence, only a brief recapitu- 
lation is presented in this paper. The inventory 
contains nine empirically derived personality 
variables, named as follows: Hs (hypochondriasis), 
D (depression), Hy (hysteria), Pd, (psychopathic 
deviate revised), Mf (masculinity-femininity), Pa 
(paranoia), Pt (psychasthenia), Sc (schizophrenia), 
and Ma (hypomania). Earlier forms of the Hs 
and Pd, scales were also used in the present 
study. In addition to the personality variables 
there are four measures of the test's internal 
validity. These scales detect subsets of individuals 
who for one reason or another do not sort the 
tems with the same attitude as other persons. 


CHAPTER II 


THE DERIVATION OF THE Ps SCALE 


3 


The “?” score is simply the number of items 
answered “cannot say.” Too large a “?” score 
impairs the validity of the entire test. The L 
(lie) scale is a set of more or less obvious items 
revealing tendencies of the respondent to put 
himself in too favorable a light. The F scale is 
composed of statistically infrequent responses and 
among other things reveals lack of understand- 
ing or uncooperativeness in taking the test. The 
most recently developed scale, K, detects more 
subtle test-taking attitudes of the respondent in 
his attempts to place himself in either a favor- 
able or unfavorable light. Although the authors 
now recommend that certain of the personality 
scales be systematically corrected in terms of K, 
this procedure has not been followed in the 
present study. Some results in this investigation 
indicate that K has a limited application and 
would be inappropriate if used with the present 
groups. 


A. THE PLAN OF INVESTIGATION 


The following plan of investigation 
was employed in deriving the Ps scale: 

1. Two criterion groups were selected, 
one of which responded well! and the 
other poorly to shock treatment. The 
former is designated as the recovered 
criterion group and the latter as the un- 
improved criterion group. i 

2. An item analysis was performed on 
all 550 items of the MMPI. The items 
which were statistically significant in dis- 
tinguishing between the criterion groups 
comprise the Ps scale. 

3. The validity of the Ps scale was 
demonstrated by its application back to 
the original criterion groups and also to 
similar independent test groups, i.e., 
groups rated recovered, improved, and 
unimproved after shock treatment. Vari- 
ous other characteristics of Ps were elic- 
ited by its application to a normal sam- 
ple, to a psychoneurotic group treated 
with brief psychotherapy, and to the post- 
shock records of the test groups. 
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4. Odd-even reliability coefficients were 
determined for the scale. 

5. The item overlap and the inter- 
correlations between Ps and the other 
scales of the MMPI were calculated. 

6. The scores on Ps were analyzed ac- 
cording to the type of shock treatment. 

7. The scores on Ps were analyzed ac- 
cording to the diagnosis. 

8. On the basis of item content and 
other findings, some theoretical formula- 
tions were offered concerning the differ- 
ences in personality structure of those 
patients who responded well and those 
who responded poorly to treatment. 

g. A separate item analysis was per- 
formed on a small group whose MMPI 
profiles did not deviate sufficiently in the 
direction of abnormality. The rationale 
for this procedure is explained on both 
clinical and statistical grounds. 


B. THE CriTERION Groups 


It is of paramount importance that 
criterion groups be selected with the 
greatest of care, for shoddy selection pro- 
cedures can introduce unreliability into 
the scale. The cases selected should be as 
“pure” as possible in terms of the varia- 
ble under consideration. If excessive 
doubt exists about a case, it should not 
be included in the criterion groups. With 
test groups, less rigorous procedures are 
in order. If the scale predicts accurately 
with loosely selected groups, it is an ex- 
cellent indication of the test’s validity. 

The criterion groups were composed of 
two extreme groups, one of which re- 


_ sponded very well and the other poorly 


to shock treatment. At the Langley Porter 
Clinic four ratings describe status at the 
termination of treatment: recovered, 
much improved, improved, and unim- 
proved, Criteria for these ratings are as 
follows: A patient is regarded as recov- 
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ered if he returns to his premorbid status, 
is making a good social and occupational 
adjustment, and expresses good insight. 
He is regarded as much improved if he 
returns to a good social and occupational 
adjustment but shows residuals of his ill- 
ness in such symptoms as emotional dull- 
ness, anxiety, etc. Improved indicates 
that there is some lessening of the inten- 
sity of the symptoms, but the funda- 
mental process is unchanged. Unim- 
proved means. that the patient is essen- 
tially unchanged. A large majority of 
these ratings were made by a single, 
highly-skilled psychiatrist. 

Ratings of recovery, social recovery, 
and essentially unimproved designate 
psychiatric status in subsequent follow- 
up studies done at three-, six-, and twelve- 
month intervals after the patient left the 
clinic. In most cases the patient was seen 
for a personal interview by a psychiatrist, 
but when this was not possible, the pa- 
tient’s condition was evaluated in a let- 
ter sent by the patient himself or by his 
relatives. 

Various members of the staff made 
these ratings. Because the much im- 
proved category is rarely used, all pa- 
tients were reclassified into three groups 
for the purposes of this study. To be 
placed in the recovered criterion group, 
a patient had to be rated recovered or 
much improved at the termination of 
shock treatment and had to maintain a 
recovery rating for one year after leaving 
the clinic. To be placed in the unim- 
proved criterion group, a patient had to 
rate improved or unimproved at the 
termination of treatment and had to 
maintain an unimproved condition for 
one year after leaving the clinic. This 
leaves a middle group, an improved 
group. To be placed in the improved 
group, a patient had to be rated much 
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improved or improved at the termination 
of treatment and had to maintain a social 
recovery for one year after leaving the 
the clinic. This latter group furnished 
one of the test groups and will be dealt 
with in a later section. Using follow-up 
studies to help classify patients insures 
greater accuracy by correcting the status 
of patients whose gains are transient. 
These patients are misclassified if status 
at the termination of treatment is the 
sole consideration. 

A few patients could not be classified 
into any of the three groups because 
their psychiatric status was markedly un- 
stable in the follow-up period. Such pa- 
tients might furnish interesting material 
for study in themselves, but their num- 
ber was too small for that purpose in the 
present investigation; hence, their rec- 
ords were discarded. Another small group 
of records was borderline, i.e., a record 
rated much improved at the termination 
of treatment and receiving both recovery 
and social recovery ratings in the follow- 
up period. In such cases the writer clas- 
sified the record with the aid of the pa- 
tient’s chart, giving most weight to status 
at the termination of treatment. If there 
was too much doubt about a case, it was 
classified but set aside for use in the test 
groups. 

No attempt was made to equate the 
criterion groups on the basis of various 
personal factors, for such requirements 
would seriously reduce the size of the 
groups. Also, the criterion groups were 
neither separated nor matched on the 
basis of the usual Kraepelinian nosology. 
Nor was the study restricted to one par- 
ticular type of shock treatment; patients 
treated either with insulin or by electri- 
cal methods were included. The rationale 
for these procedures will be set forth in a 
later section. 


One restriction in selecting patients 
was that the MMPI profile had to devi- 
ate sufficiently from normality. On the 
basis of both clinical and statistical ex- 
perience, the writer felt that the small 
subgroup whose profiles did not deviate 
sufficiently from the norm should be ana- 
lyzed separately. A record was included 
in the main criterion groups if it met 
either of the following requirements: 

1. A T-score = 70 on one or more of 
six scales, Hs, D, Hy, Pa, Pt, or Sc. 

2. A T-score = 70 on both Pd, and 
Ma even though all other scales were 
within normal limits (Mf being excluded 
from consideration). 

A record was excluded if either Pd, or 
Ma was the only scale to reach a T-score 
= 70. On the basis of these requirements 
about 20 per cent of the records were set 
aside for special study. 

A few cases were eliminated because of 
the following considerations of internal 
validity: 

1. In order to rule out carelessness or 
lack of understanding on the part of the 
respondent, records were discarded if the 
raw score on F was above 21. Although 
this score is higher than the critical score 
set by the authors, experience with clini- 
cal groups shows that F legitimately at- 
tains higher magnitudes in psychiatric 
groups than in the general population 
(12). 

2. Records with a “?’” score in excess of 
100 raw score points were eliminated be- 
cause these records distort the item 
counts if included and, of course, are of 
questionable validity. 

No restriction was placed upon the 
magnitude of either the L or K scores. 
In view of the fact that profiles must de- 
viate significantly from normal to be in- 
cluded, the error introduced from high 
scores on these scales is immaterial. 
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With these restrictions in mind, a pe- 
rusal of the clinic’s files since 1943 
yielded 184 MMPI tests administered 
from one week to one day before shock 
treatment was instituted. Of these, 42 
form the recovered criterion group, and 
a like number the unimproved criterion 
group. Some personal data are presented 
to show that this sample is not unusual 
in any respect. The recovered criterion 
group range in age from 15 to 65, with a 
mean of 37.5 years, whereas the unim- 
proved criterion group range in age from 
15 to 59 with a mean of 32 years. Any 
advantage in age resides with the unim- 
proved group. The unimproved group is 
almost equally divided in sex, 22 males 
and 20 females, while the recovered 
group contains a preponderance of 2g fe- 
males to 13 males. It is difficult to assess 
the importance of this sex difference. An 
insignificant correlation of .11 between 
scores on Ps and the Mf scale of the 
MMPI furnishes presumptive evidence 
that the masculinity-femininity score of 
the respondent is not too important a fac- 
tor in prognosis. Scores on an abbrevi- 
ated form of the Wechsler-Bellevue Adult 
Intelligence Scale were available for part 
of each group. The four subtests used 
were Similarities, Comprehension, Block 
Design, and Digit Symbol. The average 
1Q of 33 members of the recovered group 
is 109.1, and the average IQ of 26 of the 
unimproved group is 103.1. The tests 
were administered before treatment. 
These results are similar to findings with 
other patients treated at the clinic (2). 
Both groups contained a few patients 
who had received a previous course of 
shock treatment—4 in the _ recovered 
group and 6 in the unimproved group. 
The social consequences of unimprove- 
ment are quite evident in the fact that 
26 of the 42 were subsequently commit- 
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ted to institutions. Only g of the recov. 
ered group had a similar fate. It should 
be noted that recovered patients were 
committed at least one year subsequent 
to the termination of treatment and usu- 
ally enjoyed a recovered status for two 
to four years before relapsing. 

Both groups received equally intense 
courses of treatment. The recovered 
group had an average of 12 electrically 
induced conyulsions and 50 insulin co- 
mas, whereas the unimproved group had 
an average of 11 electrically induced con- 


TABLE 1 


DIAGNOSES FOR THE Two 
CRITERION GROUPS 


Criterion Group 


Diagnosis 
Recovered Unimprove! 
Affective disorders 29 9 
Schizophrenia II 22 
Psychoneurosis 2 II 
Total 42 42 


vulsions and 42 insulin comas. A some- 
what larger number of unimproved pa- 
tients received insulin treatment (15 com- 
pared to only 7 in the recovered group). 

The biggest differences between the 
two groups were in terms of diagnosis. 
Table 1 gives the distributions accord- 
ing to diagnosis, The discrepancies were 
probably not as marked as the results 
would tend to indicate, for to some de- 
gree diagnosis may be influenced by the 
patient's prognosis. This is especially true 
of patients with mixed symptoms; it 
becomes extremely difficult, to decide 
whether the patient is manic-depressive 
or schizophrenic. It cannot be decided 
on an a priori basis whether or not these 
discrepancies introduce a serious meth- 
odological error. In a later section some 
empirical evidence will be presented to 
shed light on this problem. 
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C. ANALYSIS 


The methodology involved in the item 
analysis was as follows: 

On the MMPI a “plus” response is defined as 
the direction in which an item is answered by 
the minority of the normal standardization 
group. Not all the items on the various scales of 
the MMPI are scored in the “plus” direction, 
however, because abnormal groups answer some 
items in the same way as do the majority of the 
normal standardization group, though to a statis- 
tically significant higher degree. These items 
are referred to as “zero” items. The first step was 
to sum the “plus” responses for each of the 550 
items on the MMPI for both criterion groups. 
These sums were then converted to propor- 
tions. Thus, the percentage of “plus” responses 
to each item was obtained for each criterion 
group. The difference in proportion for each 
item was then analyzed to cull out items differ- 
entiating the groups at the 2 per cent level of 
confidence. The routine work was facilitated 
by using tables prepared by Edgerton and 
Paterson (1). 


As already mentioned, the criterion 
groups contained 42 cases each. The ques- 
tion arises as to the optimal size of cri- 
terion groups. Strong (13) progressively 
increased his groups from 50 to 250 cases 
and found sufficient gains in the validity 
of his scales to recommend the latter 
number. On the MMPI the criterion 
groups have usually numbered around 
40 to 50 cases. The argument advanced 
in support of the use of these smaller 
samples is that personality structure in 
diagnostic groups is more homogeneous 
than are interests in professional groups; 
hence, stable item counts can be achieved 
with smaller samples. It is a moot point 
whether or not further increases in the 
size of the present samples would have 
added appreciably to the validity of the 
scale. Exigencies of a finite sample pre- 
cluded a definitive study of this point. 

The item analysis of the recovered and 
unimproved criterion groups produced 
52 items differentiating at the 2 per cent 
level of significance. Of the 52 items, 44 


were significant at less than the 1 per cent 
level. These items comprise the scale 
labeled “Ps” (an abbreviation for “prog- 
nostic for shock”). The 52 items on the 
Ps scale are presented below. The letter 
T or F after each item indicates the di- 
rection in which the unimproved cri- 
terion group tends to respond in contrast 
to the recovered criterion group; hence, 


_ high scores on Ps indicate a poor prog- 


nosis. 


D. Tue Ps ScALte ITEMS 


These items are listed according to 
their numbers as given in the back of the 
revised manual for the MMPI, 1943 (6). 


A-g. I think I feel more intensely than most peo- 
ple do. (T) (27, 40, 71)' 

A-50. I hardly ever feel pain in the back of my 
neck. (T) (21, 50, 28) 

B-25. I have never had any breaking out on the 
skin that has worried me. (F) (26, 24, 50) 

B-36. I dream frequently about things that are 
best kept to myself. (T) (24, 19, 50) 

B-48. I believe that my home life is as pleasant as 
that of most people I know. (F) (5, 19, 48) 

C-6. At times I have very much wanted to leave 
home, (T) (20, 31, 64) 

C-g. I have reasons for feeling jealous of one or 
more members of my family. (T) (9, 5, 24) 

C-10. Once in a while I feel hate towards mem- 
bers of my family whom I usually love. (T) 
(25, 26, 55) 

C-ig. I am apt to pass up something that I want 
because others feel that I am not going about 
it in the right way. (T) ($7, 24, 57) 

C-23. It bothers me to have someone watch me at 
work even though I know that I can do it well. 
(T) (49, 50, 73) 

C-24. I have often had to take orders from some- 
one who did not know as much as I did. (T) 
(41, 17, 50) 

C-33. It takes a lot of argument to convince most 
people of the truth. (T) (59, 33. 62) 

C-35. I liked school. (F) (14, 14, 35) 

C-42. I like to read newspaper articles on crime. 


(T) (55> 21, 50) 


*The numbers in parentheses after each item 
refer to the percentage of “plus” responses given 
to the item by the following groups. respectively: 
(a) the general MMPI normal group, (b) the 
recovered criterion group, and (c) the unim- 
proved criterion group. Items J-3 and J-37 show 
the data for only the latter two groups. 
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C-52. Many of my dreams have been about sex 
matters. (T) (8, 17, 45) 

D-1. I never attend a sexy show if I can avoid 
it. (F) (60, 38, 62) 

D-2. I like to talk about sex. (T) (74, 10, 38) 

D-45. People generally demand more respect 
for their own rights than they are willing to 
allow for others. (F) (76, 38, 12) 

D-47. Most people make friends because friends 
are likely to be useful to them. (T) (47, 21, 
42) 

D-52. I think most people would lie to get ahead. 
(T) (48, 14, 42) 

E-2. There are certain people that I dislike so 
much that I am inwardly pleased when they 
are catching it for something they have done. 
(T) (25, 19, 45) 

E-11. At times I have been so entertained by the 
cleverness of a crook that I have hoped that 
he would get away with it. (T) (g, 14, 38) 

E-17. I have never been in trouble because of 
my sex behavior. (F) (15, 10, 35) 

E-48. I never worry about my looks. (F) (49, 35, 
12) 

E-50. I do many things that I regret afterwards. 
(T) (38, 48, 76) 

E-52. People often disappoint me. (T) (56, 40, 
71) 

F-2. In a group of people I would not be em- 
barrassed to be called upon to start a discus- 
sion or give an opinion about something I 
know well. (F) (39, 40, 69) 

F-5. I wish I were not so shy. (T) (38, 48, 71) 

F-6. I am not unusually self-conscious. (F) (31, 
57» 80) 

F-10. I am more sensitive than other people. (T) 
(24, 55, 78) 

F-13. I have sometimes stayed away from another 
person because I feared doing or saying some- 
thing that I might regret afterward. (T) (41, 
31, 66) 

F-16. I have a daydream life about which I do 
not tell other people. (T) (22, 14, 45) 

F-52. My feelings are not easily hurt. (F) (46, 59, 
24) 

G-6. I have certainly had more than my share of 
things to worry about. (T) (37, 38, 66) 

G-20. Once a week or oftener I become very ex- 
cited. (T) (11, 24, 52) 


G-22. Sometimes I become so excited that I find 
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it hard to get to sleep. (T) (49, 48, 78) 

G-43. Bad words, often terrible words come into 
my mind and I cannot get rid of them. (T) 
(12, 21, 42) 

H-2. I have often felt that strangers were looking 
at me critically. (T) (34, 40, 71) 

H-g. I tend to be on my guard with people who 
tend to be somewhat more friendly than I had 
expected. (T) (68, 57, 33) 

H-10. | commonly wonder what reason another 
person may have for doing something nice for 
me. (T) (46, 33, 57) 

H-16. People say insulting things about me. 
(T) @, 14, 38) 

H-52. I have no dread of going into a room by 
myself where people have already gathered 
and are talking. (F) (27, 35, 69) 

1-8. No one cares much what happens to you. 
(T) (12, 12, 35) 

I-g. Any man who is able and willing to work 
hard has a good chance of succeeding. (F) 
(9, 5» 24) 

I-14. I frequently ask people for advice. (T) (72, 
42, 17) 

I-20. People can pretty easily change me even 
though I thought my mind was made up on 
a subject. (T) (27, 28, 52) 

I-27. I find it hard to keep my mind on a task 
or a job. (T) (10, 62, 14) 

I-35. Life is a strain for me most of the time. 
(T) (17, 57, 83) 

J-3. Usually I would prefer to work with a 


woman. (F) (—, 38, 17) 

J-37- I used to like hop scotch. (F) (—, 76, 50) 
J-41. Once in a while I think about things too 

bad to talk about. (T) (58, 64, 38) 

J-47- I do not like everyone I know. (T) (16, 33, 

10) 

Most of the items are answered in the 
“plus” direction by the unimproved 
group. Only nine of the items are scored 
as “zero” items, namely, A-50, D-45, E-48, 
H-9, 1-14, J-3, J-37, J-41, and J-47. Hence, 
to accumulate a poor prognosis score, the 
respondent must give many statistically 


deviant answers. 


CHAPTER III 
APPLICATION OF Ps TO VARIOUS GROUPS 


A. APPLICATION OF Ps TO THE CRITERION 
GROUPS AND TO NEw Groups 


HE FIRST step was to apply Ps back to 
T the original criterion groups. Table 2 
shows that Ps discriminates the criterion 
groups quite successfully. This is a neces- 
sary but not a sufficient condition for es- 
tablishing validity. The scale must also be 
able to discriminate new test groups. The 
test groups used in this study are as similar 


doubtful cases, that is, the cases which 
did not have an unequivocal rating of 
outcome, were also included. In spite of 
the more lenient standards approxi- 
mately go per cent of the test cases had 
been the subjects of follow-up study for 
at least a six-month period. The test 
groups include an improved group as 
well as recovered and unimproved 
groups. In all, there are 40 recovered, 40 


TABLE 2 
COMPARISON OF MEANS OF CRITERION Groups ON Ps 


Group N Mean 


SD Diff CR 


Recovered 42 17.0 


Unimproved 42 - 30.9 


6.3 


13-9 


6.7 


as possible to the original criterion groups, 
but, as mentioned previously, the criteria 
for inclusion of a case were not quite so 
stringent in the test groups. The restric- 
tion on the time limit in the follow-up 
period was relaxed so that recently 
treated cases and cases with incomplete 
follow-up data were included. The few 


improved, and 20 unimproved test cases. 
In age, sex, and intelligence, the groups 
are similar to the criterion groups (see 
Appendix). There are, however, fewer 
manic-depressives in the unimproved test 
group. Fewer of the unimproved test 
group were subsequently hospitalized, a 
fact which undoubtedly reflects in part 


TABLE 3 
COMPARISON OF MEANS oF TEST GROUPS ON THE Ps SCALE 


N Mean 


SD j CR 


Recovered vs. unimproved 
Recovered 40° 


Unimproved 20 


Recovered vs. improved 
Recovered 40 


Improved 40 


Improved vs. unimproved 
Improved 40 


Unimproved 20 


8.33 
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the shorter follow-up period. The differ- 
ences in personal factors in the test 
groups contrasted to the criterion groups 
are all of such a nature as to introduce 
unreliability into the test scores of the 
test groups, hence making more exacting 
demands on Ps. 

Table 3 shows that Ps works almost as 
well on the test groups as it does on the 
criterion groups. A graphic presentation 
of the discriminating power of Ps is por- 
trayed in Figure 1. Although there are a 
few extreme “misses,” the separations ef- 
fected by Ps are about as clear-cut as can 
be expected from data rated with a relia- 
bility far short of perfection. 

Another way of describing the predic- 
tive power of Ps is in terms of the over- 
lap between the prognostic groups, Com- 
plete overlap is indicated, of course, 
when 50 per cent of one group = the 
median of another group. The amount of 
overlap is crucial in determining the 


practical clinical utility of a test. Yet a/ 


perusal of the psychological literature 
reveals that overlap is seldom reported. It 


Fic. 1. Distributions of scores of test groups on the Ps scale 


is almost as if most au:hors are unaware | 


of the fact that a critical ratio is only the 
first step in establishing claims of validity 
for their tests or experiments. Table 4 in- 
dicates minimal overlap on Ps among the 


TABLE 4 


~ Per Cent OveRLAP AMONG TEST 
Groups on Ps 


Per Cent 

Group Overlap 
Recovered 2Mdn of unimproved 0.0 
Recovered 2Mdn of improved 18.0 
Improved 2Mdn of unimproved 12.0 
Unimproved S Mdn of improved 10.0 
Unimproved S Mdn of recovered 5.0 
Improved of recovered 10.0 


various test groups. Naturally, the great- 
est amount of overlap is between the im- 
proved group and each of the two ex- 
treme groups. The writer does not intend 
to explain away the test “misses,” but it 
would be interesting to follow the subse- 
quent psychiatric status of the test misses 
to see if they conform to the expectation 
of the test. For example, three patients 
were rated improved clinically but re- 
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ceived high scores on Ps. Are these pa- 
tients more likely to relapse than other 
patients rated improved clinically but 
scoring lower on Ps? 

For practical clinical use, it is desirable 
to present the data in the form that can 
be most conveniently interpreted, On 
the MMPI, scales derived from clinical 
groups are scored on a large normal sam- 
ple. The distribution of raw scores on the 
normal sample is then converted to a set 
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arising from the combined use of cri- 
terion and test cases should more than 
offset the slight loss of accuracy arising 
from this procedure. 

A much larger sample would be de- 
sirable, of course, to furnish more stable 
percentages within the various bands of 
scores on Ps. Any given score can be 
easily interpreted from Table 5. If a pa- 
tient receives a score of 29 on Ps, reading 
from the table we see that 2 per cent of 


TABLE 5 
PERCENTAGE OF EAcH TEsT Group FALLING WITHIN 


PRESCRIBED ZONES ON THE Ps SCALE 


Raw Scores on Ps 


Group 


5-8 Q-12 13-16 17-20 21-24 25-28 29-32 33-36 37-40 41-44 


Recovered 100% 100% 677% 57% 33% 20% 2% o% o% o% 
2 


Improved ° ° 


29 
Unimproved ° ° 7 14 


51 40 30 ° 33 ° 
16 40 68 100 67 100 


of standard scores with a mean of 50 
and a standard deviation unit of 10. In 
the usual use of the MMPI there is a dual 
interest. We are interested in distinguish- 
ing clinical populations from one an- 
other, but we are also interested in select- 
ing abnormals from the general popula- 
tion. For this reason the scoring norms 
are derived from the general population. 
On the Ps scale, however, interest centers 
exclusively on clinical groups; hence, the 
writer departed from MMPI tradition 
and adopted a form of presentation more 
in keeping with the nature of the scale. 
The scale was divided into ten equal 
parts. Then the percentage of recovered, 
improved, and unimproved cases falling 
within each zone of scores was computed. 
Because the means of the criterion and 
test groups are so similar (see Tables 2 
and 3), the percentages were calculated 
on the basis of the scores of the 100 test 
cases and the 84 criterion cases. The gain 
in stability within each’ zone of scores 


the patients with similar scores recover 
with shock treatment, 30 per cent im- 
prove, and 68 per cent remain unim- 
proved. The onus of whether or not to 
treat this particular case with shock treat- 
ment still rests with the psychiatrist, but 
he now has a more objective basis for 
determining the probable success of the 
treatment. The decision whether or not 
to shock depends largely on the prob- 
ability of success with alternative forms 
of treatment. Until the probabilities for 
success with various therapies can be de- 
termined with equal facility, the Ps scale 
may only serve to heighten the anxieties 
of a psychiatrist faced with a patient 
whose prognosis seems hopeless. In the 
long run, however, the scale can serve 
more as a stimulant than a deterrent. 
Knowing that patients refractive.to shock 
treatment can be isolated, workers in the 
field may be spurred on to devise new 
forms of treating these patients so that 
their prognosis can be improved. 
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B. APPLICATION OF Ps TO A GROUP OF 
NORMALS 


The writer has emphasized that the 
present scale is intended for use with 
clinical populations. Therefore, scoring 
the records of a group of normals on Ps 
has little if anything to do with its valid- 
ity. Ps is not applied to a normal sample, 
however, merely out of academic curi- 
osity, for this bit of evidence will be used 
later in discussing theoretical implica- 
tions of the scale. The MMPI records of 
25 medical students and 25 student 
nurses were scored on Ps, Although these 
samples are admittedly highly selected, 
they serve the needs of the present study. 
The mean scores on Ps are 15.8 for the 
males and 16.1 for the females—an aver- 
age score of 15.9 for the entire group. 
The small difference in the means of the 
sexes is not significant. The mean of the 
normal sample is slightly less than the 
mean of the recovered test group, which 
is 17.6. This difference between the 
means is not significant. Two critical 
points are arbitrarily set on Ps at 22 and 
28 points, dividing the scale into three 
parts labeled recovered, improved, and 
unimproved. Of the normal sample, 82 
per cent fall into the recovered category, 
12 per cent into the improved, and 6 per 
cent into the unimproved. The fact that 
Ps predicts a favorable prognosis for 
shock therapy for most members of the 
general population raises theoretical 
questions about the similarity between 
recovered patients and people in general. 
This problem is taken up later. 


C. APPLICATION OF Ps TO A GROUP OF 
PsYCHONEUROTICS 


If a scale derived from a group of psy- 
chotic patients treated by shock predicts 
accurately when applied to a group of 
psychoneurotics treated by psychother- 
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apy, there is some basis for believing that 
the factors making patients amenable or 
refractive to treatment are similar in the 
two groups. The value of the scale is also 
enhanced if it is valid for more general 
purposes. It is true, however, that in 
psychotherapy more variables operate to 
affect the results, and in a way that intro- 
duces unreliability into the ratings of 
psychiatric status. Variables like the skill 
of the therapist and the intricacies of a 
specific interpersonal relationship are im- 
portant in determining the outcome of 
psychotherapy but play relatively little 
part in shock treatment. Nevertheless, an 
attempt has been made to collect a group 
of MMPI records of psychoneurotics 
treated by brief psychotherapy. For this 
purpose there were available the records 
of a group of 53 patients who were the 
subjects in a special investigation. Four 
therapists had conducted the treatment 
of the entire group. The study has been 
described in detail elsewhere (2) so that 
the identifying data on the patients will 
not be repeated. The patients had been 
given a short form of the MMPI in which 
all items not appearing on the scales ex- 
tant at the time were deleted from the 
test. Since 11 of the deleted items appear 
on Ps, it was necessary to abbreviate Ps 
to 41 items. This procedure precludes 
any exact comparison between patients 
subjected to brief psychotherapy and 
those treated by shock. At the termina- 
tion of therapy one highly skilled thera- 
pist had rank-ordered all 53 patients 
from the most to the least improved. 
Making use of these rank orders, the 
writer arbitrarily divided the cases into 
three groups, rating the first 18 as re- 
sponding best to treatment, the next 17 
as composing the middle group, and the 
last 18 as responding most poorly to 
treatment. These ratings are not quite 
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TABLE 6 


COMPARISON OF MEANS ON THE Ps SCALE FOR PSYCHONEUROTICS 
TREATED BY BRIEF PSYCHOTHERAPY 


SD Diff CR 


II vs. III 
II 14.8 


Ill 20.5 


5-5 
7-4 


5-7 


comparable to ratings of recovered, im- 
proved, and unimproved, for there is no 
reason to believe that the arbitrary rat- 
ings arise in the equal proportions used 
for the present purpose. The results on 
the abbreviated form of Ps are summar- 
ized in Table 6. The difference in scores 
is not significant between the first two 
groups, but each of these does differ sig- 
nificantly from the third group at the 2 
per cent level of significance. In order 
to facilitate comparison with the shock 
groups, the means were weighted to 


make them equivalent to full-scale values 
on Ps. For example, in Group I, 14.9/ 
41 X 11 = 4.0, which makes 18.9 the 
equivalent score. The other equivalent 
scores are 18.8 for Group II and 26.0 for 
Group III. The means of the first two 
groups are somewhat higher than the 
mean of the group that recovered with 
shock treatment. The mean of Group 
III is between the means of the improved 
and unimproved shock groups. Although 
Ps does not work as well on the brief 
psychotherapy groups, it does predict to 


TABLE 7 


COMPARISON OF MEANS or Test Groups ON Ps BEFORE 
AND AFTER SHOCK TREATMENT 


Group N 


SD Diff 


Recovered 
Preshock 28 


Postshock 28 


Improved 
Preshock 26 


Postshock 26 


Unimproved 
Preshock 


Postshock 
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some extent. There is some evidence that 
Groups I and II in the brief psycho- 
therapy study (2, p. 274) are quite similar 
in terms of their MMPI profiles. This 
similarity in profiles may account in part 
for their identical scores on Ps. Thus, 
there is a basis for believing that Ps 
might serve as a general prognostic scale 
for all types of therapy. This sweeping 
claim would have to be subjected to 
rigorous study before the scale could be 
used discriminately. The success of Ps, 
even though limited, on the brief psycho- 
therapy group raises some interesting the- 
oretical questions. The dynamic factors 
inherent in personality structure which 
make for good or poor response to thera- 
py would seem to be similar regardless of 
overt symptomatology. Although this evi- 
dence is meager, it is consistent with the 
results obtained when Ps is analyzed on 
the basis of the type of shock treatment 
and on the basis of diagnosis. 
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D. APPLICATION OF Ps To PostsHocK 
MMPI ReEcorps OF THE TEST 
Groups 


It is of some interest to note what 
happens to scores on Ps when the scale 
is applied to postshock MMPI records. 
Table 7 presents these results for those 
members of the test groups who had been 
given both a pre- and a postshock MMPI. 
There is a significant drop in the average 
score on Ps for each group from before to 
after treatment. Thus, it would appear 
that the norms set up on the basis of pre- 
shock records cannot be applied to post- 
shock records without incurring gross 
error. It is probably best not to interpret 
Ps scores from MMPI records taken dur- 
ing the course of treatment, for even a 
few shock treatments may distort the 
scores on this scale to a marked degree. 
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A, RELIABILITY OF THE Ps SCALE 


N ODD-EVEN reliability coefficient was 
A computed on the scores of 94 of the 
test cases.1 The correlation coefficient ob- 
tained from this analysis was .75, which 
rose to .86 when corrected by the Spear- 
man-Brown formula. The magnitude of 
this coefficient compares favorably with 
the reported figures for other MMPI 
scales. 

In all their work on the MMPI, the 
authors of the test have concentrated on 
validity rather than reliability. Reliabil- 
ity looms most important, however, in 
earlier work on most other personality in- 
ventories. One can only conjecture why 
validity has been the area of concentra- 
tion in MMPI research. Generally high 
reliability was obtained by using meth- 
ods of internal consistency to purify the 
tests, for a homogeneous set of items 
more readily admits. to being measured 
with a high degree of consistency. There 
is, however, a serious drawback to us- 
ing methods of. internal consistency to 
achieve high reliability. The nontest be- 
havior which the test supposedly predicts 
is not usually of a homogeneous nature. 
Measures of internal consistency, there- 
fore, often achieve reliability at the ex- 
pense of validity by eliminating items 
which predict the criterion but are not 
consistent with the majority of the items. 
There is no need to sacrifice validity for 
reliability, however, for an alternative 
method of achieving high reliability is to 
increase the number of items on the test. 

‘The test groups were not quite complete 


when the reliability coefficient was computed; 
hence, the omission of six test cases. 


CHAPTER IV 
ANALYSIS OF THE Ps SCALE 


Thus, the very items discarded by meas- 
ures of internal consistency are the ones 
that might well be retained and, in fact, 
augmented by similar items, so that each 
of the subfactors in the scale would be 
represented in sufficient amount to be 
measured reliably. If high reliability is a 
desideratum, it is the procedure of in- 
creasing the number of items on the test 
that should be followed if validity is not 
to be impaired. 


B. IrEM OVERLAP AND INTERCORRELATIONS 


Although there is a considerable over- 
lap between items on Ps and items on all 
other MMPI scales, items on Ps do not 
comprise a large percentage of any one 
scale, as shown by Table 8. Of the 52 
items, 41 appear on at least one other 
scale, Most of the overlap occurs on the 
psychotic scales. Indeed, on the neurotic 


TABLE 8 


ITEM OVERLAP BETWEEN Ps AND 
OTHER MMPI Sca.es 


Number Com- Number Number 
Scale of mon Scored Scored 
Items Items Same Opposite 


L 15 2 ° 2 
F 64 3 3 ° 
K 30 2 ° 2 
Hs 33 I ° I 
H 55 2 ° 2 
CH 48 6 6 ° 
D 60 3 I 2 
Hy 60 7 2 5 
Pd, 50 8 6 2 
Pd 62 II 8 3 
Mf 60 8 6 2 
Pa 40 7 5 2 
Pt 48 9 9 ° 
Se 78 10 10 ° 
5 4 I 

7 9 7 2 

Not on other 

scales 169 11 _ 
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scales, the small number of communal 
items are usually scored in opposite di- 
rections. The largest percentage of over- 
lap of Ps with any other scale is 18 per 
cent with Pt. It should be noted that 30 
per cent of the MMPI items are not 
found on any of the MMPI scales. Only 
21 per cent of the items on Ps are also not 
on another scale; hence, this remaining 
pool of items on the MMPI contributes 
a smaller proportion of items to Ps than 
might be expected. 


16 MARVIN J. 


FELDMAN 


scales also have the highest correlations 
with Ps. Nevertheless, these correlations 
would still be substantial even if the over- 
lapping items were removed, because, as 
pointed out previously, the overlap is not 
great on any one scale. Hence, the gen. 
eralization can be made that high scores 
on the psychotic scales tend to go along 
with a poor prognosis, whereas scores on 
the neurotic scales seem to have little to 
do with prognosis. The most surprising 
correlations are the high negative corre- 


TABLE 9 
CORRELATION OF Ps WITH THE OTHER SCALES OF THE MMPI ON 100 Test CAsEs 


3 F K Hs D Hy Pd, 


Mf Pa Pt Sc Ma Hew (Pd 


338 -34 .62 $7 


The next step was to compute the cor- 
relations between Ps and the other scales 
on the MMPI. The records of the 100 
test cases were used because they repre- 
sent the population on whom the scale is 
to be used. The results are given in 
Table 9. The intercorrelations are given 
for the published scales and for several 
scales which are no longer in general 
use. A factor which tends to lower the 
correlation coefficients is the marked 
skewness of most of the distributions, the 
Pearsonian r not being a maximally de- 
scriptive statistic in such a case. A corre- 
tation coefficient with a magnitude of .25 
is significant at the 1 per cent level with 
a sample of this size. 

The D, Hy, and Mf scales fail to meet 
this level of significance; in fact, all three 
are far short of being significant. The 
other scales, however, have a highly sig- 
nificant correlation with Ps. Although 
skewness tends to lower the intercorrela- 
tions, the item overlap between scales 
may spuriously raise them. Common ele- 
ments are greatest on the psychotic and 
the psychopathic deviate scales, which 


lations of Ps with both L and K, which 
cannot be considered to be spuriously 
high since the item overlap is negligible 
with both scales. The K scale has been 
interpreted by Meehl and Hathaway (10) 
as a correction for an unconscious tend- 
ency of the respondent to put himself in 
either a favorable or unfavorable light. 
A high K score calls for an upward revi- 
sion of several of the MMPI scales. In 
the present study, however, a high K 
score goes along with a favorable prog- 
nosis. This fact seems to cast some doubt 
on the generality of K, and on the valid- 
ity of the authors’ recommendation that 
all records be systematically corrected for 
K. From the evidence in the present 
study, it seems that K has a different 
meaning for these patients selected for 
shock treatment—in fact, just the oppo- 
site meaning from that intended by the 
authors. It may be that K works best on 
the subgroup for whom it was originally 
designed, namely, clinical populations 
| with normal profiles; hence, the K cor- 
jrection might best be restricted to this 


group. 
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TABLE 10 


MEANS AND STANDARD DEVIATIONS ON Ps oF TEST GROUPS IN RELATION 
TO THE TyPE oF SHOCK TREATMENT 


Treatment 


Improved Unimproved 


N Mean 


Mean SD 


Electric shock 
Electronarcosis 
Insulin 


22 ‘ 28.4 4. 
5 27.8 5. 
13 ; f 31.0 5. 


C. RELATION OF Ps TO TyPE OF SHOCK 


In the derivation of Ps, patients were 
lumped together without regard for the 
type of treatment received. Patients in 
the study were treated with insulin, elec- 
tronarcosis, or electric shock. An objec- 
tion might be raised that the use of 
mixed groups obscures results inasmuch 
as the efficiency of the treatment is sup- 
posed to vary with the type of patient. 
In this study the average score on Ps for 
all patients treated with electric shock 
is 21.3, and for all patients treated with 
insulin, 25.8. This difference is statisti- 
cally significant. The average score on Ps 
for all patients treated with electronar- 
cosis is 23.1, which does not differ signi- 
ficantly from that of either of the other 
two groups. If it is true, however, that 
insulin produces better results on pa- 
tients with a poor prognosis than does 
electrical treatment, then patients treated 
with insulin should have more favor- 
able ratings of psychiatric status with 
correspondingly higher scores on Ps, 
and the reverse should hold for pa- 
tients treated electrically. Hence, a se- 


ries of tests was made to determine the 
effect of the type of treatment. All 40 test 
cases rated recovered clinically were di- 
vided into three groups on the basis of 
the type of treatment. The groups were 
then compared with one another by 
means of the ¢-test (11). The improved 
and unimproved test groups were simi- 
larly analyzed. The results are collected 
in Tables 10 and 11. None of the nine 
comparisons reveals a significant differ- 
ence. The type of treatment does not 
seem to affect predictions on Ps. These 
results based upon so few cases are cer- 
tainly not conclusive, although they are 
highly suggestive. These results may, how- 
ever, be affected to an unknown degree 
by the clinical judgments that went into 
deciding why patients were to receive the 
treatment which was actually adminis- 
tered. Nevertheless, the results lend cred- 
ence to the notion that all three treat- 
ments are equally efficacious. To obtain 
more unequivocal results, an equal num- 
ber of matched patients would have to 
be given the three treatments and the 
choice of treatment would have to be 


TABLE 11 


TESTS FOR SIGNIFICANCE BETWEEN TEST Groups RATED THE SAME CLINICALLY BUT 
TREATED WITH DIFFERENT KINDS OF SHOCK 


Recovered 
Treatment 


Improved Unimproved 


t 


ECT vs. I 
ECT vs. EN 
EN vs. I 


1.85 
0.63 
°.73 
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TABLE 12 


MEANS AND STANDARD DEVIATIONS ON Ps oF TEst Groups 


IN RELATION TO DIAGNOSIS 


Recovered 


Treatment 


Improved Unimproved 


N Mean SD 


N Mean SD N Mean SD 


Aff. dis. 23 16.4 5-9 
Schiz. 13 20.1 5.2 
Psychoneur. 2 18.5 5-5 


15 $3.2 4-4 I 30.0 — 
17 26.4 5-9 12 30.4 4.0 
8 23.9 7 6 27.2 5.9 


made solely on the basis of the match- 
ings. Incidentally, the effect of psycho- 
therapy on psychotic patients could be 
assayed in the same way. It might also be 
pointed out that Ps furnishes a rational 
basis for selecting equated groups to put 
this suggested hypothesis to a more rigor- 
ous test. 


D. RELATION OF Ps To DIAGNOSIS 


As stated earlier, diagnosis was also 
ignored in selecting prognostic groups. 


- 


the unimproved group includes more 
schizophrenics. The average score on Ps 
is 19.4 for all patients diagnosed as affec- 
tive disorders, 24.4 for all psychoneu- 
rotics, and 25.6 for all schizophrenics. 
The differences between the average 
scores of the affective disorders and of 
each of the other two groups are signifi- 
cant, but the difference between the 
schizophrenic and the psychoneurotic 
groups is not significant. Nevertheless, if 
diagnosis as such is related to test results, 


TABLE 13 
TESTS FOR SIGNIFICANCE BETWEEN DIFFERENT DIAGNOSTIC GROUPS 


WITHIN THE SAME PROGNOsTIC CATEGORY 


Recovered 


Diagnosis 


Improved Unimproved 


df t 


df t P df t P 


Aff vs. Sc 34 1.82 .07 
Aff vs. PN 23 ©.47 .60 
PN vs. Sc 13 0.37 .70 


30 1.68 II 0.09 
21 0.34 +70 5 ©.40 +70 
23 1.00 +30 6 1.28 


An objection might be raised that Ps 
merely discriminates the affective dis- 
orders from schizophrenics. This propo- 
sition can be subjected to the same type 
of test as was done for the effect of the 
type of treatment. Each prognostic group 
contains cases of affective disorders,? 
schizophrenics, and severe psychoneurot- 
ics. To be sure, the recovered group in- 
cludes more affective disorders whereas 


* The affective disorders include manic-depres- 
sive and involutional patients because the latter 
are too few in number to be analyzed separately. 
Most of the patients in the psychoneurotic cate- 
gory were diagnosed as obsessive-compulsive or 
severe anxiety hysteria. 


scores on Ps within a single prognostic 
category should differ significantly when 
subgroups are compared on the basis of 
diagnosis. 

The records of the 100 test cases were 
again utilized, but three cases were 
omitted because they were not assigned 
a definite diagnosis. The means of all sub- 
groups were analyzed by t-tests to deter- 
mine whether any of the differences 
achieves statistical significance. The re- 
sults are presented in Tables 12 and 13. 
None of the differences is statistically sig- 
nificant; therefore, differential diagnosis 
seems to have little effect on the predic- 
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tive power of Ps. It should be pointed 
out that some of the subgroups—espe- 
cially the unimproved affective disorders 
—are composed of very few cases. This 
fact decreases the exactness of the com- 
parisons. The scores of the schizophrenic 
group are consistently, even though not 
significantly, higher than those of other 
groups. Nevertheless, in terms of the arbi- 


trary threefold classification of improve- 
ment on Ps, the outcome for the majority 
of schizophrenics is correctly predicted. 
Eight of the 13 recovered, 10 of the 17 
improved, and g of the 12 unimproved 
schizophrenics are placed correctly by Ps. 
Of the entire group of 42 schizophrenic 
test cases, only 1 is misplaced by two steps 
in the three-step classification on Ps. 
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CHAPTER V 


DISCUSSION AND INTERPRETATION OF Ps 


NE OF the aims of the present study 
O is to gain insight into the differ- 
ences between the prognostic groups. Any 
a posteriori explanation of data is, of 
course, subject to question. The real test 
of explanations is whether or not they 
lead to further formulations which can 
be subsequently studied. 

The item content furnishes many clues 
about the nature of the prognostic 
groups. In the first place, Ps contains an 
unusually large number of items which 
refer to interpersonal relationships and 
only a few items which refer to sympto- 
matic complaints, although the entire 
pool of items on the MMPI contains 
almost equal numbers of each kind. ‘That 
is, the items on Ps refer to interpersonal 
relations in the family, at work, and so- 
cially, rather than to physical ailments, 
fears, mood disorders, or disorders of 
thought. In so far as overt behavior can 
be inferred from responses to items, it 
can be conjectured that the presenting 
symptomatic picture of members of the 
various prognostic groups is quite simi- 
lar, and that the chief differences be- 
tween the groups will be found in the dy- 
namics of genetic development and per- 
sonality structure. 

Carrying this point somewhat further, 
patients who subsequently recover re- 
spond to these particular items even be- 
fore treatment in much the same way as 
a group of normals. This is shown by the 
fact that the recovered and normal 
groups have almost identical average 
scores on Ps. The mean of the recovered 
group, is 17.6, and the mean of the se- 
lected sample of normals is 15.9. A com- 
parison of the item counts of the recov- 
ered group with the original normative 


data of the MMPI' reveals that only 14 
of the 52 items differ by as much as 20 
per cent, which is approximately at the 
5 per cent level throughout most of the 
range of proportions. On g of these 14 
items, the item counts of the normal 
group are actually higher in the “plus” 
direction. In contrast, 38 of the 52 items 
differ between the unimproved and the 
normal group, and in all but 5, of these, 
the unimproved group has the higher 
percentage of “plus” responses. Each 
member of the prognostic groups must 
have at least one elevated score on the 
other MMPI scales; yet on this set of 
prognostic items, the responses of the re- 
covered group are similar to those of the 
normals. This finding becomes eluci- 
dated, in part, when some theoretical 
sense is made of the content of the items. 

‘The answers in the unimproved direc- 
tion on Ps are consistent with the picture 
of a person who has withdrawn from a 
world perceived as hostile. These 
spondents express open dissatisfaction 
with the family group, e.g., “I believe 
that my home life is as pleasant as that 
of most people I know” (F), and “At 
times I have very much wanted to leave 
home” (T). It can be conjectured that 
the poor identifications established in the 
family group have been generalized to 
other authority figures as shown by, “I 
am apt to pass up something that | 
want to do because others feel that I am 
not going about it in the right way” (T), 
and “I have often had to take orders from 
someone who did not know as much as | 
did” (T). Unimproved patients seem to 
have very poor object relations. They 


* The writer is indebted to the authors of the 
MMPI for making these data available. 
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perceive other people as being exploita- 
tive, unfriendly, and hostile, e.g., “Most 
people make friends because friends are 
likely to be useful to them” (T), and 
“People say insulting things about me” 
(I). There seems to be nothing about 
their lives that enhances their self-esteem; 
consequently, they express marked feel- 
ings of inadequacy, e.g., “In a group of 
people I would not be embarrassed to be 
called upon to start a discussion or give 
an opinion about something I know 
well” (F), and “I am not unusually self- 
conscious’’ (F). 

These people seem to have no sources 
of ego strength. They feel unable to cope 
with their environments. Also, they feel 
dependent upon arbitrary external forces 
which show no respect for their rights. 
This theme is summed up by the state- 
ments, “People can pretty easily change 
me even though I thought my mind was 
made up on a subject,” and “No one cares 
much what happens to you,” which are 
answered ““True” by patients remaining 
unimproved, They seem to recognize 
their sorry plight (they can see that every- 
thing is wrong, including themselves); 
but since they are unable to cope with 
their problems, they have no motivation 
to get well. It seems quite possible that 
many of them feel that a psychotic ad- 
justment is the best possible form of ad- 
justment, for at least they are relatively 
free from the demands of a hostile en- 
vironment, It is interesting to note that 
as a group they tend to have low K scores. 
Hathaway (3) has suggested that K can 
be thought of as a continuum from 
capacity for reflective self-analysis at the 
low end to defensiveness and obtuseness 
at the high end. The only possible way 
that insight can be attributed to the un- 
improved group is in the trivial sense 
that they realize that in view of their un- 
fortunate circumstances, there is no point 


in trying to get well. This, of course, is 
not the usual connotation of insight. 

The patients in the recovered group, 
on the other hand, are still trying to 
establish good object relations. In view 
of their psychotic condition there is good 
reason to doubt the verity of many of 
their statements. The important thing, 
however, is that they perceive their en- 
vironment as being relatively friendly 
and rewarding, and they feel that they 
are in better rapport with their family, 
friends, and self. Their attitude with re- 
spect to their interpersonal relations 
seems Pollyannish; hence, their high K 
scores. They can admit their symptoms 
but must repress their underlying inter- 
personal conflicts. 

By definition, individuals with severe 
personality disorders have poor interper- 
sonal relations. Although the answers on 
Ps of the recovered group are similar to 
the answers of normals, it should not be 
concluded that the recovered group are 
similar to the normals in ego strength or 
in the capacity to form good object re- 
lations. Rather, the answers of the re- 
covered group might be thought of as 
representing a potentiality for greater ego 
strength and better object relations. This 
potentiality seems to be lacking in the 
unimproved group. However, the re- 
sponses of the recovered patients may re- 
flect the actuality of greater ego strength 
and better object relations, even before 
treatment, than holds in the case of the 
unimproved patients. At any rate, pa- 
tients who recover perceive that there are 
many worthwhile things in life for them; 
so they have motivation to recover. Their 
motivation is also enhanced by the fact 
that they perceive themselves as being 
capable of coping with many of their 
problems. 

It should be apparent that the preced- 
ing analysis is of the momentary dynam- 
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ics of the two groups. We should like to 
know the particular family constellations 
that led to the different motivational sys- 
tems, What causes the unimproved group 
to have such vulnerable egos? What are 
the sources of ego strength that give some 
patients a greater propensity to recover 
from a psychotic condition? Unfortu- 
nately, these questions cannot be an- 
swered from an analysis of the properties 
of the present scale. The answers to such 
questions must come from long-range 
genetic studies and intensive interview 
material. 


The differences in response to items on Ps 
may also cast some light on the nature of cur- 
rent nosological systems. The present results in- 
dicate that there are wide differences in personal- 
ity structure among a group of individuals with 
highly similar presenting symptoms, The cor- 
relations of Ps with other MMPI scales (Table 
9) indicate that unimproved patients are char- 
acterized by high scores on the psychotic and 
psychopathic deviate scales, whereas recovered 
patients have significantly lower scores on these 
scales; yet both groups are composed chiefly of 
psychotics. Evidently, patients who subsequently 
recover are diagnosed as psychotics clinically on 
the basis of their overt symptoms, and little 
attention is paid to their interpersonal relations. 
It would seem to follow that there will be many 
discrepancies between diagnoses based upon the 
MMPI and those based upon clinical judgment. 
However, many of the discrepancies would arise 
from the nature of the diagnostic categories in 
current use. Although these discrepancies limit 
the efficiency of the test as a diagnostic instru- 
ment, the limitations may be more apparent 
than real, for it may be that what is needed is a 
modification of the present system of diagnosis. 

It is seen from Table 11 that Ps cuts across 
diagnostic groups rather effectively. This is not 
the first instance of a prognostic test doing so. 
The Elgin Prognostic Scale for Schizophrenia 
(15) works equally well in predicting the outcome 
of manic-depressives, Then, too, Ps has some 


- success in separating the brief psychotherapy 


group. There is a growing dissatisfaction with the 
Ktaepelinian nosology for many reasons. Chief 
of these is the fact that so many cases present 
such diffuse symptoms that they defy clear-cut 
diagnosis. If we examine the reasons why it is 
desirable to classify subgroups of psychiatric pa- 
tients, the immediate purpose seems to be to 
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convey a lot of information in a few summary 
terms. This implies that a body of knowledge js 
correlated with each of the divisions made. |j 
the divisions are equivocal, the probability of 
relating them meaningfully to other variables is 
reduced. The proper classificatory system, then, 
is the one that summarizes the most knowledge 
by virtue of its high correlation with a large 
body of meaningful facts. Not only should the 
categories be correlated with known facts, but 
they should be convenient divisions for further 
study. 

The present psychiatric classifications are 
phenotypic in that diagnosis is based largely on 
overt symptomatology, i.e., physical complaints, 
fears, mood swings, thought content, etc. The 
Kraepelinian system undoubtedly has some merit, 
as witnessed by the tenacity with which this 
nosology is retained, It may be, however, that 
psychotic patients who recover with treatment 
form a more genotypic group than do patients 
classified into one of the diagnostic categories, 
e.g., schizophrenia. By this the writer means that 
a classificatory system based upon prognosis 
rather than current diagnostic categories may be 
collated with other variables in a more mean. 
ingful way than the present system allows. 

Essential agreement with this position is shared 
by Wittman (16), who distinguishes “process” 
schizophrenia from “schizophreniforme” on the 
basis of prognosis. The latter embraces cases 
whose symptomatology resembles schizophrenia 
but who have a good prognosis because they do 
not have the stormy childhood and difficult 
adolescence which tend to lead to the withdrawal 
and indifference characteristic of the “process” 
schizophrenic. She compared 66 adult schizo- 
phrenics who as children had been referred to a 
clinic for study, with a similar number of 
schizophrenics who had no known history of 
childhood referral. The groups differed markedly 
on the Elgin Prognosis Scale; the former had a 
much poorer prognosis. Wittman cites this study 
as one bit of evidence for believing that it is 
fruitful to divide schizophrenics into the two 
groups she suggests. The study also points up the 
fact that thinking in terms of prognosis rather 
than diagnosis leads to productive research. 

There is a great deal of equivocal data in the 
field of diagnostic testing which would probably 
be elucidated in part if the data were analyzed 
on the basis of prognosis. The writer does not 
believe that it is either advisable or feasible to 
dispense with the present system of nosology. He 
does believe that a dual system of classification 
could be employed in most psychological studies 
whereby results would be analyzed in terms of 
prognosis as well as diagnosis. By this means, 
some of the defects of present diagnostic group 
ings might be circumvented. 
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CHAPTER VI 
THE LOW-PROFILE GROUP 


N STANDARDIZING Ps certain require- 

ments were established for including 
cases in the criterion groups. Abou 20 
per cent of the cases failed to meet the re- 
striction placed on the magnitude of the 
T-scores on the personality variables of 
the MMPI. These excluded cases had T- 
scores below 70 on all scales or on all 
scales except Pd, or Ma, but not both. 
This excluded group numbers 44 in all. 
The results on this group are now pre- 
sented. 

When a breakdown for clinical ratings 
was made, 20 were rated recovered, 20 un- 
improved, and only 4 were rated im- 
proved. The rating procedure was exactly 
the same as in the main study. The 
groups were somewhat younger on the 
average than the main groups; the re- 
covered group had a mean age of 30.3 
years, whereas the unimproved group had 
a mean of 25.6. The groups were also a 
little more intelligent than the main 
groups; the average IQ on the short form 
of the Wechsler-Bellevue was 118 for the 
recovered and 108 for the unimproved. 
There was a preponderance of females in 
both groups, 13 in the recovered group 
and 19 in the unimproved group. The 
proportion of females in the unimproved 
group was much higher, whereas the sex 
ratio in the recovered group was quite 
similar to that in the main study. The 
distributions of diagnoses were most dis- 
similar to those in the main study. The 
recovered group was split evenly, 10 
schizophrenics and 10 affective disorders, 
whereas the unimproved group con- 
tained 18 schizophrenics and 1 each of 
affective disorders and psychoneurotics. 
It is difficult to evaluate the meaning of 
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these personal factors, but it is interest- 
ing to note that a great many of the 
schizophrenics were of the paranoid type. 


A. Scores ON Ps 


The records of the recovered and un- 
improved groups were first scored on Ps. 
The average score of the recovered group 
was 14.1 and of the unimproved group, 
13.3. These scores do not differ signifi- 
cantly. Both means are actually lower 
than the mean of the recovered group in 
the main study. Furthermore, 37 of the 
40 cases would be predicted to recover 
by Ps. Thus, it is apparent that Ps has 
little value in predicting the results of 
this selected group. 


B. Item ANALYSIS 


In spite of the small-sized samples and 
the lack of an independent test group, an 
item analysis was carried out between 
the records of the 20 recovered and the 
20 unimproved cases. Only 17 items dif- 


significantly between the two 
groups at the 5, per cent level. This num- 
ber is even less than would be expected 
solely through errors of random sam- 
pling. Only a few of the items were signifi- 
cant at the 2 per cent level. With such 
barren results, there was no reasonable 
chance that these items comprised into a 
scale would predict the outcome of treat- 
ment better than chance for the groups 
in question. Therefore, the attempt to 
predict the outcome of shock treatment 
for this subgroup was abandoned, at least 
for the time being. 

The writer does not believe that these 
cases are merely test “misses” in the 
sense that their psychosis should have 
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been reflected in high scores on the exist- 
ing scales of the MMPI. Their ability to 
respond to the test in a way that avoids 
high T-scores probably reflects essential 
differences in personality structure. Cer- 
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tainly, this group should be challenging 
to many of our notions about psycho- 
pathology, especially if it is found that 
they simulate normality on other per- 
sonality measures. 
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1. The aim of this research was to de- 
vise a scale to predict the probability of 
success of shock treatment. This was done 
by the empirical selection of MMPI items 
on which the responses of a criterion 
group of recovered patients differed signi- 
ficantly from the responses of a criterion 
group of unimproved patients. 

2. The resulting scale of 52 items se- 
lected by the item analysis was labeled 
Ps. This scale not only discriminated the 
original criterion groups with a high de- 
gree of accuracy but worked almost as 
well on independent test groups. The 
scale predicted accurately enough to war- 
rant its use for individual prediction. 

3. The magnitude of the odd-even re- 
liability coefficient was fairly high, com- 
paring favorably with the reliability of 
other MMPI scales. 

4. The scale significantly differentiated 
a group of psychoneurotics with respect 
to outcome of treatment by brief psycho- 
therapy, but the overlap between the 
outcome groups was too great for this 
finding to be anything but suggestive. 

5. The correlation of scores on Ps with 
other MMPI scales varied considerably. 
It had uniformly high positive correla- 
tions with the psychotic scales, little re- 
lationship to the neurotic scales, and high 
negative correlations with LZ and K. 
These latter correlations called into ques- 
tion the general applicability of the K 
scale. 

6. Scores on Ps do not seem to be af- 


CHAPTER VII 


SUMMARY AND CONCLUSIONS 


fected materially by either the type of \ 


shock treatment or the diagnosis. The in- 


herent propensity to improve seems to | 
be the main variable affecting scores on ) 


Ps. 

7. Members of the unimproved group 
were characterized as having little ego 
strength and little motivation to improve, 
whereas members of the recovered group 
were characterized as persons still strug- 
gling to maintain object relations as well 
as having greater motivation to improve. 

8. A separate analysis was made of a 
subgroup of patients with essentially nor- 
mal MMPI profiles. No effective way was 
found of predicting their response to 
treatment. 

The Ps scale is certainly not the last 
word in predicting response to therapy. 
Nevertheless, it works well enough to 
furnish a practical tool for use with a 
fairly wide range of patients. What is 
even more important is that the scale 
may be used for other research problems: 

a) It may serve as a rational basis for 
selecting matched groups of patients in 
comparing the effectiveness of various 
types of treatment, e.g., insulin vs. elec- 
tric shock. 

b) It may be used to isolate patients 
with a poor prognosis, for the purpose of 
finding better techniques of treatment. 

c) It may also clarify some aspects of 
current psychiatric nosology by pointing 
out basic similarities among groups dif- 
ferently classified by the present system. 
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APPENDIX 


DATA ON PROGNOSTIC GROUPS 


A. HospitALizATION 


Group N* 


Per Cent 
Previously 
Treated 
by Shock 


Per Cent 
Subsequently 
Hospitalized 


Recovered criterion 42 
Unimproved criterion 42 
Recovered test 40 
Improved test 40° 
Unimproved test 20 
Low-profile recovered 20 


Low-profile unimproved 


21 
62 
18 
10 
15 
15 
45 


* 


B. PERSONAL DATA 


The number of cases in each group in B, C, and D is the same as in the groups in A. 


Average 


Group Age 


Sex 


Preshock 


Intelligence 


N 


Mean 


Recovered criterion 37-5 
‘ Unimproved criterion 32.0 
Recovered test 38.5 
Improved test 34-5 
Unimproved test 30.5 
Low-profile recovered 30.3 
Low-profile unimproved 25.6 


103 
107 
102 
118 
108 


C. DIAGNOsIS 


Affective 


Group Disorder 


Schizo- 


phrenic 


Psycho- 
neurotic 


Recovered criterion 60% 
Unimproved criterion 22 
Recovered test 58 
Improved test 38 
Unimproved test 5 
Low-profile recovered 5° 


Low-profile unimproved 


26% 5% 
52 26 
31 5 
42 20 
60 30 
50 ° 


LD. Type or SHock TREATMENT 


Electric 
Group Shock 


Electro- 
narcosis 


Recovered criterion 85% 
Unimproved criterion 43 
Recovered test 62 
Improved test 55 
Unimproved test 35 
Low-profile recovered 75 
Low-profile unimproved 20 


2% 13% 
17 40 
15 18 
12 33 
20 40 

5 20 
15 65 


= 
| | 
14 
18 
25 
20 
20 20 
te 
| M F = 
31% 69% 33 
52 48 26 
43 57 15 
28 72 14 
40 60 4 
35 65 9 
| 5 95 10 
| 
| 
5 
° 
| 5 go 5 ° 
Un- 
o% 
| 
5 
° 
26 
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